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Abstract 

The Hopfield model in a transverse field is investigated in order to clarify 
how quantum fluctuations affect the macroscopic behavior of neural networks. 
Using the Trotter decomposition and the replica method, we find that the a 
(the ratio of the number of stored patterns to the system size)-A (the strength 
of the transverse field) phase diagram of this model in the ground state resem- 
bles the a-T phase diagram of the Hopfield model quantitatively, within the 
replica-symmetric and static approximations. This fact suggests that quan- 
tum fluctuations play quite similar roles to thermal fluctuations in neural 
networks as long as macroscopic properties are concerned. 
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Neural networks have been investigated very actively in the context of physics and en- 
gineering in terms of simple mathematical models inspired by anatomical and physiological 
facts about the brain In these models, the state of a neuron is often described by an 

Ising spin, corresponding to the firing or at-rest state. Neurons are connected with each other 
by long-range interactions, and if these interactions are chosen suitably, some fixed patterns 
of spins remain dynamically stable. Thus, the system works as an associative memory. 

In the time-evolution process of real neurons, randomness appears in signal transmission 
at a synapse: A pulse reaching the terminal bulb of an axon does not always result in 
the release of neuro-transmitters contained in vesicles. Usually, this randomness in signal 
transmission has been taken into account in models as thermal fluctuations, which leads to 
a statistical-mechanical formulation of neural networks (see Sec. 2.1.3. of Ref. 0). That is, 
the "Hamiltonian" 7i is defined so as to give stable fixed patterns of the relevant network 
as global or local minima of the energy landscape. The "temperature" T is next introduced 
and the "partition function" is defined hj Z = Tre^^/-^ for a given sample of embedded 
patterns. The "free energy" is then obtained from the quenched average over the samples 
as F = -r((logZ)). 

However, detailed considerations of the origin of randomness in signal transmission sug- 
gest that quantum effects may be an important driving force to cause uncertainty in the re- 
lease of neuro-transmitters from vesicles into the synaptic cleft. For example, Stapp pointed 
out that stochastic characters of signal transmission at synapses may be explained by 
quantum uncertainty in the positions of calcium ions during migration in the terminal bulb 
of an axon. Beck and Eccles argued that quantum fluctuations can be of comparable 
order as thermal fluctuations in the hydrogen bridges within axon terminals which control 
the exocytosis of synaptic vesicles. These investigations strongly indicate the necessity to 
treat randomness in the signal transmission in terms of quantum mechanics. 

Under these motivations, we investigate a neural network with quantum fluctuations. 
In the conventional statistical-mechanical approach to neural networks the parame- 

ter (temperature) T is introduced into a Hamiltonian system. This parameter does not 
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necessarily reflect directly the detailed stochastic properties of the original time-dependent 
neuron system. Nevertheless, the effect of the parameter T is still regarded as a prototype 
of thermal fluctuations. Similarly, the introduction of quantum fluctuations at the level of 
the Hamiltonian formulation of the problem is expected to be helpful in clarifying the roles 
of quantum effects in the original system. Admittedly, the model deflned below is not a 
faithful reproduction of real processes in the brain. However, our purpose is not to explain 
the brain itself in detail . We rather aim to clarify the statistical-mechanical roles of quan- 
tum fluctuations inlarge-scale networks at a phenomenological level. We believe that our 
model serves as a flrst step toward this goal. Another motivation to develop the following 
argument is that our method of investigation provides a typical framework to treat quantum 
spin systems with quenched randomness. 

Let us therefore consider the Hopfleld model in a transverse fleld, 

n = -Y.J^,^t^■-^T.<^■^'Ho + 'H, , (1) 

with the synaptic weight Jtj deflned by the Hebb rule, 

J^^ = ^tm- (2) 

The transverse fleld triggers quantum tunneling from one state to another. Even when T is 
vanishing, phase transitions are expected to occur as the strength of the transverse fleld A 
is varied. 

Since TCq and Hi do not commute with each other, we use the Trotter decomposition 

as 

Z = Tre-^« = hm Tr (e-(^no/M ^-m^/M\^ (3) 

with j3 = 1/T. Although the parameter T seems indispensable in the present formulation, 
the existence of the T ^ limit can be justifled [§, at least for the present type of quantum 
fluctuations. When the number of embedded patterns p becomes inflnite {a = p/N ~ 0(1)), 
the self-averaging property does not hold any more ^ , and the random average with respect 
to samples should be taken on the basis of the replica method, 
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/ = —U\ogZ)) = Liim 1. (4) 

Actual evaluation of the above expression can be carried out by applying the method of 
Amit et al. to the decomposed system (H). After long but straightforward calculations 
T0| , the free energy per spin is expressed using only the Ising variable (Jp{k) = ±1 as 



Y M p n 2 a ^'^ ^ 



"^^^■^ k=l At=l p=l k=l p=l 

n M M n n n M M n 

+ ^EEE E r,^ikJ)qpAk,l) + ^,j:T.T.tpik,l)S,{k,l) 

k=l 1=1 p=l (T=l,(^p) k=l 1=1 p=l 

- ^((losEexp^^ E ^'pm'opik) - ilogtanh^|:a,(fc)a,(A: + 1) 

■ "^'EE^P^(^>Oc^p(A:K(/) + ^EEa^,0^p(^K(ol\V (s) 



^^'^ k,i ^^'^ k,i p /II 

where {Ap(A;)} stand for the eigenvalues of the following Mn x Mn matrix, 

J^kpM = ^klSpa - J^^P'rik, I) - J^5paSp{k, I) , (6) 

with 

1 ^ 

qpa{k, = ^ E (^ip{k)(^M , (7) 



i=l 

N 



Spik,l) = ^Y.^^pik)a,pil) . (8) 
i=i 

There appear five kinds of order parameters m'^{k), qp^{k,l), rp^{k,l), Sp{k,l), and 
tp{k,l). The variables p and a represent replica indices, and k and / stand for Trotter 
indices. From the saddle-point equations with respect to these order parameters, they are 
expressed as 

<w = ((^Eer(M^)))) , (9) 

gp.(A:,0 = ((^E(M^))(^^^(0))) , (10) 

rp.{k,l) = - E (K(^X(0)) , (11) 

^ p=s+l 



1 ^ 



Spik,l) = {{-Y.Mk)){a,,il)))) , (12) 



i=l 



t,^{k,l) = ^ {{m^^{k)m^^{l))) , (13) 

where s denotes the number of condensed patterns for which the parameter m^{k) remains 
finite in the — > oo hmit. Especially, in the single- retrieval case, s = 1. Although the 
first three order parameters also appear in the replica calculation of the Hopfield model 
aside from the dependence on Trotter indices, the last two order parameters are specific 
to the present model. In the present type of path-integral formulations of quantum spin 
systems, the Trotter index k can be identified with an imaginary-time index. Then, the 
quantities Sp{k, I) and tp{k, I) may be considered to be related with dynamical properties 
of the quantum spin system described by the Hamiltonian though this "dynamics" is 
nothing to do with the real time evolution of original neurons. 

For further analytic calculations, we introduce the replica-symmetric approximation 
i9|JTT|l defined by m^p{k) m^{k), qpa{k,l) q{k,l) for p ^ a, rp„{k,l) r{k,l), 
Sp{k,l) S{k,l) and tp{k,l) t{k,l). As will be shown later, this approximation is 
justified in most of the parameter regions of a and A even at T = 0. The resulting ex- 
pression of the free energy is still too complicated for analytic studies. Thus, we adopt the 
static approximation |jTl[] in which we set m^{k) —>■ m^, q{k, I) —>■ q, r{k, I) r, t{k, I) —>■ t, 
S{k, I) ^ S for k I and S{k, I) 1 for k = I. This name (static approximation) origi- 
nates from the fact that the correlations along the Trotter (or imaginary-time) direction are 
averaged out in this approximation. Among these five order parameters, the static approxi- 
mation seems quite reasonable for m'^{k), q{k, I) and r{k, I), because the physical meaning of 
these order parameters (overlaps of an embedded pattern, SG order parameters and effects 
of uncondensed patterns) suggests very slight dependence on Trotter indices. On the other 
hand, the static approximation leads to a superficial inconsistency for S{k,l) and t{k,l). 
That is, direct calculations of these quantities within the static approximation [|10| result 
in the Trotter-layer dependence of S{k,l) and t{k,l). However, these quantities appear in 
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the free energy only as the sum over all the Trotter layers. Thus, the static approximation 
recovers consistency after such a summation is carried out pO[] . 

On the basis of these approximations, the Mn x Mn matrix can be diagonalized for 
any values of M and n. Taking the limits M — ^ oo and n ^ 0, we have 



a 



^ 2/3 



\og{l +Pq-pS) 



(5q 



l + j3q-j3S 



(3{l - S) 



-af3{rq - ts) 



T Uj Dzhg 2 J Dw cosh (3^J (j2f, ^^"^^ + v^-^ + \/<^{t - r)w^ + 



(14) 



where Dx denotes the Gaussian measure, dxe~^^^'^/ ^/2tt. When we take the A — limit, this 
expression coincides exactly with that of the Hopfield model [^], as expected. Extremizing 
this free energy with respect to m, q, r, S and t, we obtain a set of equations which describes 
static properties of the present model for any a, A and T. 

The limitation of the static approximation has already been recognized in the SK model 



in a transverse field ||TT[. In the SK model, this approximation overestimates the critical 
transverse field A^, because the symmetry between Trotter layers is broken owing to the 
infinite degeneracy of ground states in each layer. This symmetry breaking is missed by the 
static approximation. In spite of such difficulties, this approximation holds at least in the 
vicinity of A = or « = 0. In the former case (A 0), quantum fluctuations are small, 
and therefore the validity of the static approximation is easily accepted. In the latter case 
(a ~ 0), the free energy of the model (|I|) can be calculated exactly without using the replica 
method for p finite (or a —>■ 0), and the result is consistent with the present one |jTO[. From 
a physical point of view, the finite-p case is a straightforward generalization of the Mattis 
model |T2[, and the symmetry between Trotter layers would not be broken. 

In order to see the effects of quantum fiuctuations in the absence of thermal noise, we 
now consider the case of T = 0. Then, the phase diagram within the replica-symmetric and 
static approximations can be obtained from the following set of equations. 



m 



+ 00 



Dz 



m + Jarz 



m + ^/arz) + A^ 



(15) 
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/•+~ (m + ^zf 

"'-oo (m + Jarz) + 



r+oo A 2 

C = I Dz- —-^ , (17) 

(m + warz) + 



oo 



3/2 

(18) 



(1-C)2 ■ 

The parameters 5* and t in Eq. (0) satisfy S = q and t = r (the differences S — q and t — r 
are of the order of T), respectively. Note that the new parameter C originates from this 
0{T) contribution. 

The solution of Eqs. (p^)-([T8|) reveals that the structure of the phase diagram is quite 
similar to that of the Hopfield model, as shown in Fig. |I]. The phase boundary between the 
retrieval phase (m 7^ and q ^ 0) and the SG phase (m = and q ^ 0) can be evaluated 
only by solving numerically the integral equations (p!5|)-(p!8|) directly, because this transition 
is of first order. Unexpectedly, the shape of this phase boundary is quite similar to that of 
the Hopfield model even quantitatively, when the parameter T is replaced by A. The 
asymptotic form of the phase boundary around a = turns out to be Ac ~ 1 — 1.95^/a 
T0| in exact agreement with that of the Hopfield model, ^ 1 — 1.95y/a [^. The critical 



capacity ac — 0.1379 at A = agrees with the corresponding Hopfield value |^ by definition. 
The line of the second-order phase transition between the SG phase and the paramagnetic 
phase (m = and q = 0) can be calculated analytically by setting m = and expanding 
the formulas (p^)-(p!8|) to the lowest order of r (r and q are of the same order in the vicinity 
of this phase boundary). The critical value of the transverse field is given by Agg = 1 + y/a. 
This expression is exactly the same as that of the Hopfield model , when A is replaced by 
T, again an unexpected result. 

The results presented above can be derived much more easily. First, we apply the mean- 
field approximation to the Hamiltonian (|1]): 

1 N P 

i=l ^=1 

Next, we require the self-consistency condition as (af ) = (o"|)efr, where (■ ■ ■)efT stands for the 
average with respect to the effective Hamiltonian ([T9|) , and we have |]13 



^ EC^K) = ^Eer ^"^^"^^ tanh/3y(E,e^,)%A^ . (20) 



j=l ^' i=l 



For finite p, all the results of the replica calculations [0 can be obtained from this equation. 



Even if p is of the order of A^, Geszti's approximation [|13[ can be applied to this model to 
obtain the same set of equations given in (|T5|)-(|1^) |T^. This fact supports the validity of 
the replica-symmetric and static approximations used above. 



Since the expression of the free energy (jl^) has been derived explicitly, we can go further 
than the above mean-field approach. Comparing the values of the free energy of the retrieval 
and SG solutions, we obtain the phase boundary between the global-minimum retrieval 
phase (R-I) and the local-minimum retrieval phase (R-II) as displayed in Fig. [l|. This 
phase boundary is also similar to that of the Hopfield model in the vicinity of A = 1: 
Ac = 1 - 2M25^/a, while in the Hopfield model, ~ 1 - 2.6^/a g. Near A = 0, 
reentrant behavior is observed. Although this behavior has not been reported explicitly in 
the Hopfield model P], we have found by detailed calculations that this reentrant behavior 
also takes place in the classical case. These classical and quantum phase boundaries resemble 
each other even in this region. 

The AT line can be calculated by generalizing the analysis in the case of the Hopfield 
model 0. After some tedious calculations [|10|, we find that this line is given by the solution 
of the following equation, 

q = arA* / Dz- -3 . (21) 

(m + y/arzf + A^ 

The AT line is shown in Fig. ||. A nontrivial reentrant phase transition between the SG and 
retrieval phases also seems to occur in the vicinity of A = and a = 0.1379. However, the 
reentrant region around A = and a = 0.1379 lies below the AT line. A similar property 
is reported in a recent detailed calculation of the Hopfield model The shape of the AT 
line of the present quantum model is quite similar to that of the Hopfield model given in 
Ref. W^, if the parameter A is replaced by T. 
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In summary, the Hopfield model in a transverse field was introduced and investigated 
using the Trotter decomposition and the replica method. The replica-symmetric and static 
approximations enabled us to treat the problem analytically. We found that the ground-state 
phase diagram of this model is quite similar to that of the Hopfield model, when the strength 
of the transverse field A is replaced by the temperature T. We also showed that the same 
phase diagram can be obtained by the mean-field approximation. Using the expression of 
the free energy, the phase boundary on which the retrieval states become the global minima 
and the AT line have been obtained. These two boundaries are also similar to those of the 
Hopfield model. 

It is appropriate to stress here that the qualitative and quantitative coincidence of the 
properties of the T = quantum system with those of the finite-temperature classical system 
is quite nontrivial. In consideration of quantum aspects of randomness in signal transmission 
0,^, our results may serve as an a postenon justification of the conventional classification 
of macroscopic phases of the Hopfield model if this model is regarded as a primitive but 
first step toward understanding emergent properties of the brain functioning. The method 
in this Letter provides also a statistical-mechanical framework for analysis of systems in 
which both quenched randomness and quantum fluctuations are present. 

One of the present authors (Y. N.) is grateful for the financial support of the Japan 
Society for the Promotion of Science for Japanese Junior Scientists. Numerical calculations 
were performed on FACOM VPP 500 at the Institute for Solid State Physics, University of 
Tokyo. 
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FIGURES 

FIG. 1. The ground-state phase diagram of the Hopfield model in a transverse field. "R-I" 

stands for the retrieval phase in which the retrieval states are the global minima, and ""R-II" denotes 
the retrieval phase where the retrieval states are the local minima. The dashed line represents the 
AT line. The vicinity of a = 0.1379 and A = is shown magnified in the inset. 
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